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Abstract 

We search for lepton-fiavor-violating r decays into three leptons (electron or muon) using 535 
fb of data collected with the Belle detector at the KEKB asymmetric-energy e + e~ collider. No 
evidence for these decays is observed and we set 90% confidence level upper limits on the branching 
fractions between 2.0 x 10 -8 and 4.1 x 10~ 8 . These results improve the best previously published 
upper limits by factors from 4.9 to 7.0. 

PACS numbers: 11.30.Fs; 13.35.Dx; 14.60.Fg 
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INTRODUCTION 



Lepton flavor violation (LFV) appears in various extensions of the Standard Model (SM), 
e.g., supersymmetry (SUSY), leptoquark and many other models. In particular, lepton- 
flavor- violating decavs into t~ — > i~£ + £~ (where £ = e_or \i ) are discussed in various SUSY 



models [H, 0, y, 0, H,"@, 0] , models with little Higgsjpl, [9| , left-right symmetric models 10 



as 



well as models with heavy singlet Dirac neutrinos [TJJ and very light pseudoscalar bosons [12 
Some of these models with certain combinations of parameters predict that the branching 
fractions for r~ — > £~£ + £~ decays can be as high as 10~ 7 , which is already accessible in 
high-statistics B factory experiments. Searches for LFV r decays into three leptons have a 
long history 13], which starts from the pioneering experiment of MARKII [l3|. In previous 
high-statistics analyses, both Belle and BaBar reached 90% confidence level (C.L.) upper 



limits on the branching fractions of the order of 10 7 
data. Here, we update our previous results using 535 fb 



15, 16 , based on about 90 fb 1 of 



of data collected with the Belle 



collider [l7j, taken at the T(45) resonance 



detector at the KEKB asymmetric-energy e + e~ 
and 60 MeV below it. 

The Belle detector is a large-solid-angle magnetic spectrometer that consists of a silicon 
vertex detector (SVD), a 50-layer central drift chamber (CDC), an array of aerogel threshold 
Cherenkov counters (ACC), a barrel-like arrangement of time-of-flight scintillation counters 
(TOF), and an electromagnetic calorimeter comprised of CsI(Tl) crystals (ECL), all located 
inside a superconducting solenoid coil that provides a 1.5 T magnetic field. An iron flux- 
return located outside the coil is instrumented to detect K® mesons and to identify muons 
(KLM). The particle identification is based on the ratio of the energy deposit in the ECL 
to the momentum measured in the SVD and CDC, the shower shape in the ECL, the 
particle range in the KLM, the hit information from the ACC, the dE/dx information in 
the CDC, and the particle time-of-flight from the TOF. The detector is described in detail 
elsewhere 18|. The leptons are identified using likelihood ratio, (V(e)) for electrons 19j and 
iV{jj)) for muons 20j, which are based on electron and muon probabilities, respectively. 

In order to estimate the signal efficiency and to optimize the event selection, we use Monte 
Carlo (MC) samples. The signal and the background events from generic r + r~ decays are 
generated by KORALB/TAUOLA j2l[. In the signal MC, we generate r + r~, where a r 
decays into three leptons and the other r decays generically. All leptons from r~ — > £~£ + £~ 



decays are assumed to have a uniform angular distribution in the r lepton's rest frame [22 
Other backgrounds including BB and e + e~ — > qq (q = u, d, s, c) events, Bhabha events, 
e + e~ — > and two-photon processes are generated by EvtGen 

KKMC ' 



23 , BHLUMI 24 



21 , and AAFHB 25 



respectively. All kinematic variables are calculated in the 
laboratory frame unless otherwise specified. In particular, variables calculated in the e + e~ 
center-of-mass (CM) system are indicated by the superscript "CM". 



EVENT SELECTION 

We search for t + t~ events in which one r decays into three leptons (signal r), while the 
other r decays into one charged track, any number of additional photons, and neutrinos (tag 
r). Candidate r-pair events are required to have four tracks with a zero net charge. Thus, 
the decay chain to be reconstructed is: 
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{t~ -> + {r+ -> (a track)+ + (n > 7) + X (missing) }[f]. 

Here, all possible combinations of three leptons in the signal r decay, which include the 
e~e + e~ , e~/i + /i~, /i~e + e~, /i~e + /i~, and e~/i + e~ modes, are searched for. Because 

the background components differ between signal decay modes, the selections described 
below are optimized separately for each mode. 

The event selection starts by reconstructing four charged tracks and any number of pho- 
tons within the fiducial volume defined by —0.866 < cosO < 0.956, where 9 is the polar 
angle relative to the direction opposite to that of the incident e + beam in the laboratory 
frame. 

The transverse momentum (p t ) of each charged track and energy of each photon (E^) are 
required to be p t > 0.1 GeV/c and E 1 > 0.1 GeV, respectively. The distance of the closest 
point for each charged track with respect to the interaction point is required to be within 
±0.5 cm in the transverse direction and within ±3.0 cm in the longitudinal direction. 

The particles in an event are then separated into two hemispheres referred to as the signal 



and tag sides using the plane perpendicular to the thrust axis [26j. The tag side contains 
a charged track while the signal side contains three charged tracks. We require all charged 
tracks on the signal side to be identified as leptons. The electron (muon) identification 
criteria are V(e) > 0.9 (V(fi) > 0.9) for the momentum greater than 0.3 GeV/c (0.6 GeV/c). 
The electron (muon) identification efficiency for our selection criteria is 91% (85%) while 
the probability to misidentify pion as electron (muon) is below 0.5% (2%). 

To ensure that the missing particles are neutrinos rather than photons or charged particles 
that pass outside the detector acceptance, we impose additional requirements on the missing 
momentum vector p m i SS , which is calculated by subtracting the vector sum of the momenta 
of all tracks and photons from the sum of the e + and e~ beam momenta. We require that the 
magnitude of p m i SS be greater than 0.4 GeV/c, and that its direction point into the fiducial 
volume of the detector. 

To reject qq background, we require that the magnitude of thrust (T) be 0.90 < T < 0.97 
for all modes except for the r~ — > e~e + e~ mode for which it should be 0.90 < T < 0.96. 
We also require 5.29 GeV < E™ < 9.5 GeV, where E™ is the total visible energy in the 
CM system which is defined as the sum of the energies of three leptons, the charged track 
on the tag side (with a pion mass hypothesis) and all photon candidates. 

Since neutrinos are emitted only on the tag side, the direction of p m i SS should lie within 
the tag side of the event. The cosine of the opening angle between p m i SS and the charged 
track on the tag side in the CM system, cos#°" miss , is therefore required to lie in the range 
0.0 < cos#{? a g_ miss < 0.98. The reconstructed mass on the tag side using a charged track 
(with a pion mass hypothesis) and photons, m tag , is required to be less than 1.777 GeV/c 2 . 
As shown in Fig. [TJ reasonable agreement between data and background MC is obtained in 
the distributions of cos#f" miss and m tag . 

Conversions (7 — > e + e~) are a large background for the r~ — ■> e~e + e~ and fi~e + e~ modes. 
We require that the cosine of the opening angle between the direction of the e + e~ pair and 
the other lepton in the CM system, (cos 0^ on _ CD ) be less than 0.90 if the invariant mass of 
the e + e~ pair (M ee ) is less than 0.2 GeV/c 2 for these modes. As shown in Fig. [2] for the 



[|] Unless otherwise stated, charge-conjugate decays are implied throughout this paper. 
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FIG. 1: Kinematic distributions used in the event selection: (a) the cosine of the opening angle 
between a charged track on the tag side and missing particles in the CM system (cos 6>^_ miss ); 
(b) the reconstructed mass on the tag side using a charged track and photons after E^^ 1 and 
T event selection. While the signal MC (r~ — > jjT ji + distribution is normalized arbitrarily, 
the background MC are normalized to the same luminosity as that of data. Selected regions are 
indicated by the arrows from the marked cut boundaries. 
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FIG. 2: Scatter-plots of the reconstructed invariant mass of the e + e~ pair (M ee ) vs. cosine of the 
opening angle between the direction of the e + e~ pair and the other electron (cos 6*^ on _ cc ) for (a) 
data, (b) Bhabha and eeee, (c) signal MC (r~ — > e~e + e~) 



t~ — > e~e + e~ mode (two entries from each event), the signal efficiency is not affected by 
this cut, while the large background from the conversions can be reduced. 

For the t~ — > e~e + e~ and — > e~fi + fi~ modes, the charged track on the tag side is 
required not to be an electron by applying V(e) < 0.1 since a large background still remains 
from two-photon and Bhabha events. Furthermore, we reject the event if the charged track 
on the tag side is in gaps between barrel and endcap of the ECL. To reduce backgrounds 
from Bhabha and events, we require that the momentum in the CM system of the 

charged track on the tag side be less than 4.5 GeV/c for the r~ — > e~e + e~ and r~ — > fi~e + e~ 
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TABLE I: The selection criteria for the missing momentum (p m iss) and missing mass squared 
( m miss) correlations for each mode, p m i ss is in GeV/c and m misg is in (GeV/c 2 ) 2 . 



Mode 


Hadronic tag mode 


Leptonic tag mode 




-> fi ll 




Pmiss > -3.0m miss - 1.0 


Pmiss > — 2.5?TT. miss 


T~ 


— > /^~e~ 


-e" 


Pmiss > 3.0m miss — 1.5 


Pmiss I'^Tlmigg 1 


T~ 


— > e~/i^ 


>~ 






r _ 


— > e~e" 1 


~e~ 


Pmiss ^ 3.0?Tl m j ss 1.0 
Pmiss > 4.2771^ ~ 15 


Pmiss > — 2.5?7l m j ss 

p miss > 2.0m miss - 1 




— > e + /i" 


>- 


N.A. 


N.A. 


t~ 


— > /^ + e~ 









modes. 

Finally, to suppress backgrounds from generic t + t - and qq events, we apply a selection 
based on the magnitude of the missing momentum p m i SS and missing mass squared m miss for 
all modes except for r _ — > e + n~ ji" and /i + e~e~. We do not apply this cut for the latter 
modes since backgrounds for them are much smaller. We apply different selection criteria 
depending on whether the r decay on the tag side is hadronic or leptonic: two neutrinos 
are emitted if the r decay on the tag side is leptonic, while one neutrino is emitted if the 
r decay on the tag side is a hadronic one. Therefore, we separate events into two classes 
according to the track on the tag side: leptonic or hadronic. The selection criteria are listed 
in Table HJ the distributions of m miss and p m i SS for hadronic and leptonic decays are shown 
in Fig. [31 

SIGNAL AND BACKGROUND ESTIMATION 

The signal candidates are examined in the two-dimensional plots of the l~t r l~ invariant 
mass (Mm), and the difference of their energy from the beam energy in the CM system (AE). 
A signal event should have close to the r-lepton mass and AE close to zero. For all 
modes, the M^ and AE resolutions are parameterized from fits to the signal MC distribu- 
tions with an asymmetric Gaussian function that takes into account initial state radiation. 
The resolutions of M^ and AE for each mode are summarized in Table [Til 

To evaluate the branching fractions, we define elliptical signal regions determined from 
fits to the Msi and AE distributions as shown in Table [III These signal regions are optimized 
by signal MC, so that 90% of the signal events that passed all the selections are contained 
in the signal region. 

We blind the data in the signal region and estimate the signal efficiency and the number 
of the backgrounds from the MC and the data outside the signal region, so as not to bias 
our choice of selection criteria. Figure H] shows scatter-plots for the data and the signal MC 
distributed over ±20<r in the M%e — AE plane. No events are observed outside the signal 
region for any modes except for r~ — > e~e + e~ in which four events are found. The remaining 
background events in the r~ — > e~e + e~ mode are expected to come from a Bhabha electron 
or t~ — > e~v T v e and two electrons from a gamma conversion. The final estimate of the 



7 



Hadronic tag decay 
(a) r — > /i./i-zi- MC (b) tt MC 



< 4 

> 

o 

« 3 



Q_ 2 




< 4 
> 

CD 3 



Q_ 2 

















I" ii 


:Y*ri*. ..; * 
i" ••: <•:• - • 

i 




i *T 

li 1 



5 10 

m 2 mi »« ((GeV/c 2 ) 2 ) 



m 2 ° mi » 5 ((GeV/c : 



10 



) 2 ) 



Leptonic tag decay 
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FIG. 3: Scatter-plots of p m i ss vs. m 2 ^: ( a ) an d (b) show the signal MC (t~ — > n~ fi + n~) and 
the generic t + t _ MC distributions, respectively, for the hadronic tag while (c) and (d) show the 
same distributions for the leptonic one. Selected regions are indicated by lines. 



TABLE II: Summary of M$£ and AE resolutions 



Mode 


ogf (MeV/c 2 ) 


(MeV/c 2 ) 


a*f (MeV) 


(MeV) 


T~ 


-> p fl + fl 


4.8 


5.4 


12.5 


15.7 


T~ 


—s- e~e + e~ 


5.1 


7.8 


13.4 


25.1 


T~ 


— > e~/i + /i~ 


5.1 


5.6 


12.1 


19.6 


T~ 


— > /i~e + e~ 


5.0 


6.6 


13.4 


21.3 


T~ 


— > e + fj>~[i~ 


5.0 


6.0 


13.3 


19.9 


T~ 


— > /i + e~e~ 


5.4 


6.7 


13.8 


23.0 



number of the background events is based on the data with looser selection criteria in the 
M 3 £ sideband region, which is defined as the box inside the horizontal lines but excluding the 
signal region, as shown by the lines in Fig. HI Assuming that the background distribution 
is uniform in the sideband region, the number of background events in the signal box is 
estimated by interpolating the number of observed events in the sideband region into the 
signal region. The signal efficiency and the number of expected background events for each 
mode are summarized in Table IIHI 

We estimate the systematic uncertainties due to the lepton identification, the charged 
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TABLE III: The signal efficiency (e), the number of the expected background events (-/Vbg) esti- 
mated from the sideband data, total systematic uncertainty (c syst ), the number of the observed 
events in the signal region (iV b s ), 90% C.L. upper limit on the number of signal events including 
systematic uncertainties (sgo) and 90% C.L. upper limit on the branching fraction (£>) for each 
individual mode. 



Mode 


£(%) 


^BG 


O-syst (%) 


N ohs 


S90 B( 


xHT 8 ) 




— ► e e" 1 


"e 


6.00 


0.40±0.30 


9.8 





2.10 


3.6 




-» f-r^ 




7.64 


0.07±0.05 


7.4 





2.41 


3.2 


T~ 


— > e~ /i" 1 




6.08 


0.05±0.03 


9.5 





2.44 


4.1 


T~ 


— > [i~e~ 




9.29 


0.04±0.04 


7.8 





2.43 


2.7 


T~ 


— > e + fi~ 


>~ 


10.8 


0.02±0.02 


7.6 





2.44 


2.3 


T~ 


— > /x + e" 




12.5 


0.01±0.01 


7.7 





2.46 


2.0 



track finding, the MC statistics, and the integrated luminosity. The uncertainty due to 
the trigger efficiency is negligible compared with the other uncertainties. The uncertainties 
due to the lepton identification are 2.2% per each electron and 2.0% per each muon. The 
uncertainty due to the charged track finding is estimated to be 1.0% per charged track. The 
uncertainty due to the e-veto on the tag side applied for the r~ — > e~e + e~ and r _ — > e~[i + fi~ 
modes is estimated to be the same as the uncertainty due to the electron identification. 
The uncertainties due to MC statistics and luminosity are estimated to be (0.5 - 0.9)% and 
1.4%, respectively. All these uncertainties are added in quadrature, and the total systematic 
uncertainty for each mode is listed in Table IIHI 



UPPER LIMITS ON THE BRANCHING FRACTIONS 



Finally, we open the blind and find no events in the signal region. Since no events 
are observed in the signal region, we set upper limits on the branching fractions of r~ — > 
£~£ + £~. The 90% C.L. upper limit on the number of the signal events including a systematic 
uncertainty (sgo) is obtained from the number of expected background events and observed 
data, calculated by the POLE program without conditioning 
Feldman-Cousins method 



27 , which is based on the 



28 



by 



The upper limit on the branching fraction (£>) is then given 

b(t- ^re + e~) < (i) 



2N TT e 



where N TT is the number of r + r~pairs, and e is the signal efficiency. N TT = 492 x 10 6 
is obtained from 535 fb" 1 of integrated luminosity times the cross section of the r pair 
production, which is calculated in the updated version of KKMC j29| to be a TT = 0.919 ± 
0.003 nb. The 90% C.L. upper limits on the branching fractions B(t~ — > £~£ + £~) are in the 
range between 2.0 x 10 -8 and 4.1 x 10 -8 and are summarized in Table llTTl These results 
improve the best previously published upper limits [15|, [l6| by factors from 4.9 to 7.0. 



9 




-0.4 



1.65 1.7 1.75 1.8 1.85 

m eee (GeV/c 2 ) 





1.65 1.7 1.75 1.8 1.85 



nVe (GeV/c 2 ) 



1.7 1.75 1.8 1.85 

m w (GeV/ c 2 ) 




(GeV/ c ) 



FIG. 4: Scatter-plots in the - AE plane: (a), (b), (c) , (d), (e) and (f) correspond to the 
±20cj area for the r~ — > e~e + e~~, t~ — > r~ — » e~/x + /i~, r~ — > /.i^e + e~, r~ — > e + /i~/i~ 

and r~ — > fi + e~e~ modes, respectively. The data are indicated by the solid circles. The filled 
boxes show the MC signal distribution with arbitrary normalization. The elliptical signal regions 
shown by a solid curve are used for evaluating the signal yield. The region between the horizontal 
solid lines excluding the signal region is used to estimate the expected background in the elliptical 
region. 
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SUMMARY 



We have searched for lepton-flavor-violating r decays into three leptons using 535 fb 1 
of data. No events are observed and we set the 90% CL. upper limits on the branching 
fractions: B(t~ -> e~e + e~) < 3.6 x 10~ 8 , B(t~ -> < 3.2 x 10~ 8 , B(t~ -> 

e"/i + /i") < 4.1 x 10" 8 , B(r~ -»■ ^"e+e") < 2.7 x 10~ 8 , B(t~ -> e+ >" >") < 2.3 x 10~ 8 and 
£>(r~ — > /i + e~e~) < 2.0 x 10~ 8 . These results improve the best previously published upper 
limits by factors from 4.9 to 7.0. These more stringent upper limits can be used to constrain 
the space of parameters in various models beyond the SM. 
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